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1 Artificial Intelligence 


For a two-class classification problem with classes C, and Co, we will use the following 
linear classifier with probabilistic output 


Pr(C\|x, w, wo, 8) = o6 (w’x + wo) (1) 


where x is an input vector and w, wo and @ are parameters, and 


1 
ee 1+ exp(—@z) 


is the activation function. 


(a) The activation function og often appears assuming 0 = 1. What role does 0 play 
when its value can be set freely? [1 mark] 


(b) You are provided with a collection s = ((x1,y1),.--;(Xm,Ym)) of m training 


examples where y; € {0,1} for i = 1,...,m. You suspect that the data has a 
band-like structure. In two dimensions: 


a) 


| 


Cy 
Ci 


Co 


v1 


Explain how the linear classifier can be modified, changing only its activation 
function and without adding further parameters, such that it can be trained on 
this type of data. It should be possible to set the width of the C; region as part 
of the training. [6 marks] 


(c) When using a two-class classifier h(x,p) that has parameters p and outputs 
probabilities, one often uses the error measure 


BpyS= So yi log h(xi, p) + (1 — yi) log(1 — A(&, p))- 
i=1 
Explain how the gradient descent method can be applied to solve this 


classification problem for the data described in Part (6), giving explicit formulae 
for the gradients. [13 marks] 
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2 Artificial Intelligence 
This questions concerns the Partial-Order Planning Algorithm. 
(a) How does an ordering constraint differ from a causal link? [2 marks] 


(b) Why is it necessary for the Partial-Order Planning Algorithm to consider both 
ordering constraints and causal links? [2 marks] 


A game involves filling a finite grid with coloured tiles. For a position (x,y) not on 
the first row or column, its ancestors are defined as positions (a —1,y) and (x, y—1), 
where the origin is at the bottom-left. For a given grid state, a tile can be placed at 
an empty position (2, y) if and only if: 


e its four adjacent squares are empty; or 
e both ancestors have a tile, and the placement satisfies the Placement Rules; or 


e only one ancestor has a tile, and the other ancestor can be filled later in a way 
consistent with the Placement Rules. 


If a tile has been placed on every square, then the Finish state has been reached. 


We will focus on a specific instance of the game with a 6-by-6 grid, where the colours 
are white, gray and black, and the Placement Rules are as follows: 


7" O "s 


In our instance the start state is fixed. Here are some possible moves from the start 
state, where a crossed square represents an empty grid position: 


Solve the following problems using the Partial-Order Planning Algorithm. 


(c) Explain how the Start and Finish states can be represented for the instance 
given above. Only a description is required. [3 marks] 


(d) Explain how actions can be represented modeling the placement of tiles, by 
giving examples based on the specific instance described above. [7 marks] 


(e) Explain the concepts of promotion and demotion, which are of central 
importance in the Partial-Order Planning algorithm. To what extent might 
they be useful in the case of this particular algorithm and planning problem, 
given your formulation? Illustrate your answer with an example. [6 marks] 
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3 Economics, Law and Ethics 
The new Master of (fictional) Porterhouse would like to modernise the college website, 
using generative AI to create both the html and content. They bring the proposal to 


the College Council, of which you are a member. 


(a) Discuss the challenges presented by intellectual property and generative AI. 
[6 marks] 


(b) Use either consequentialist or deontological reasoning to argue in favour of or 
against the proposal. Additionally, please define the ethical philosophy you will 


be employing in your argumentation. [6 marks] 


(c) One of the Fellows is concerned about the existential risk of generative AI. 
Discuss this risk and explain other risks from AI. [8 marks] 


4 Economics, Law and Ethics 


(a) Explain information asymmetry, and how it can lead to a lemon market. 


[6 marks] 
(b) What solutions can help prevent a lemon market? [6 marks] 
(c) How is information asymmetry relevant to privacy? [8 marks] 
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5 Formal Models of Language 


An intrepid linguist encounters an alien while exploring a remote planet, she 
documents an alien language that has four sounds, © = {a,e, f,m}. The following 
are examples of the alien’s speech and a translation: 


e amaf nice spaceship 

e faem nice spaceboots 

eeamaf very nice spaceship 

eee faem extremely nice spaceboots 


The linguist hypothesises that Expression 1 matches sound sequences in the alien 
language. 


Expression 1: e*(ale|f|m)(ale|f|m)* 
(a) Describe the strings that are matched by Expression 1. [2 marks] 


(b) Provide a Finite State Automaton that can generate the language defined by 
Expression 1. [2 marks] 


As the linguist continues to explore, she encounters a grumpy alien and documents 
the following utterances: 


fama eamaf not nice spaceship (unpleasant spaceship) 
meaf e e faem very unpleasant spaceboots 
afaf eee fafa extremely unpleasant gift 


The linguist hypothesises that Expression 2 matches sound sequences in the language. 


Expression 2: w~te*w where w € X* 


(c) Can the linguist draw a Finite State Automaton to generate the language defined 
by Expression 2? Provide a proof for your answer. [5 marks] 


(d) Provide a grammar that can generate the language defined by Expression 2. 
[5 marks] 


On the far side of the planet, the linguist encounters a new dialect and documents 
the following utterances: 


amaf e amaf unpleasant spaceship 
faem e e faem very unpleasant spaceboots 
mefaem ee e mefaem extremely unpleasant earthling 


(e) Provide a general expression to match such sound sequences. [1 mark] 


(f) Can you use a Context Free Grammar to generate the language defined by your 
expression? Provide a proof for your answer. [5 marks] 
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6 Formal Models of Language 


Two friends, Andrew and Brian, live on the top of adjacent hills. In order to reduce 
their telephone bills, they decide to try communicating using a flag. They use one 
flag that can be held in one of four positions (Left, Right, Up, Down). To evaluate 
their proposed system they do a trial. Every 5 seconds Andrew holds the flag in a 
different position and Brian notes down where he thinks the flag is. The results of 
their trial are below: 


(a) 


ANDREW’S FLAG POSITION 
LEFT RIGHT | UP DOWN 
LEFT || 2 0) 1 1 
BRIAN’S OBSERVATION reco || 2 : : 
UP 2 8 4 2 
DOWN || 2 0) 2 4 


Let X be a random variable for the flag positions produced by Andrew. As- 
suming the trial is probabilistically representative of the underlying distribution, 
write down the distribution of X over the discrete set of flag events ¥ = {LEFT, 
RIGHT, Up, Down} [1 mark] 


What is the entropy, H(X), of X in bits? Provide relevant equations AND 
describe in words what H(X) represents in this scenario. [2 marks] 


Let Y be a random variable for the flag positions seen by Brian. Calculate the 
joint entropy H(X,Y) in bits AND comment on whether this is the ideal joint 
entropy for this scenario. Provide relevant equations. [2 marks] 


What is the conditional entropy H(Y|X) in bits? Provide relevant equations 
AND describe in words what H(Y|X) represents in this scenario. — {2 marks] 


Calculate the mutual information between X and Y in bits AND explain what 
this tells us about their communication system. Provide relevant equations. 
[3 marks] 


Provide an attested lower bound on the channel capacity for Andrew and Brian’s 
communication system. Explain your answer providing any relevant equations. 
[3 marks] 


Do you think this will be an effective way for Andrew and Brian to communicate? 
Explain your answer. [2 marks] 


Andrew suggests using two positions for the flags instead of four. What do you 
think about this suggestion? What two positions would you choose and why? 
Explain how you could quantify the benefit (a numerical answer is not required). 

[5 marks] 
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7 Further Graphics 


(a) You are given a unit length rod as in the figure. There is no rotation at one end 


of the rod at point x9 and a rotation around the plane normal n is defined at 
the other end x,. This rotation is interpolated along the rod. The interpolation 
weight for x on the rod is ||x — x,|| for the rotation at x, i = 0,1. 


x9 8 


(1) Write the rotation in quaternion form at x given a rotation of 9 <7 at x, 
assuming shortest path interpolation of rotations in SO(3). [3 marks] 


(i7) At x, at time t = 0 there is no rotation and at t = 1 the rotation angle is 
7/2. Write the quaternion at x at any time in [0,1] assuming the shortest 
path interpolation in SO(3) over time and over the rod. [3 marks] 


(277) Answer (ii), this time assuming linear blending of quaternions along the 
rod and the shortest path interpolation in SO(3) over time. [3 marks] 


(iv) Write an expression for the norm of the quaternion in (777). [3 marks] 
Given a triangle in 3D with vertex locations v1, v2, v3, 


(2) determine a condition on the vertices for the triangle to define a valid plane, 
[1 mark 


(17) define a parametric form p(u,v) for the plane of the triangle assuming it 
defines a valid plane, [2 marks 


(iii) write an expression for the normal of the plane, [1 mark 


(iv) write the steps of an algorithm to find the closest point of a point x in 
space on the triangle. [4 marks 
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8 Further Graphics 


This question is on rendering a scene via ray tracing and the rendering equation. 


(a) You are tasked with rendering a video of a scene via ray tracing. Only the 


camera is moving, the rest of the scene is static, the light sources emit light of a 
single wavelength, and surfaces do not emit light. You are allowed to shoot one 
ray per pixel and do pre-computation for a rotation and position of the camera. 
For each of the following cases, explain if this is possible, and if so, describe 
what you would pre-compute and store in single-channel textures, and how you 
would finally render the scene. 


(¢) Local illumination and a single BRDF (bidirectional reflectance distribution 
function) for all surfaces. [3 marks] 


(2) Global illumination and diffuse reflection for all surfaces. [3 marks] 


We are rendering a scene via path tracing and approximating integrals with 
importance-sampling. 


(i) Assume you can importance-sample with the exact incoming radiance. 
Write the resulting approximation of outgoing radiance at any point and 
direction with N samples. What is the length (number of segments) of the 
light path to compute this approximation? Why is this length finite? 

[5 marks] 


(ii) There is only a single point light source in a scene, only light paths of length 
three are allowed, and no shadow rays are allowed. What would be your 
importance-sampling strategy, and why at the first and second intersection 
points for a given path? [4 marks] 


For a given scene, assume the rendering equation can be reduced to L,(x,W>) = 
¢ fio V(x, @;) cos O,dcj; at surface points x, where V is the (binary) visibility 
function. 


(i) What are the properties of the scene that make this reduction possible? 
[3 marks] 


(72) Assuming a single object and ignoring inter-reflections for that object, what 
is the gradient of L,(x,w,) with respect to x? [2 marks] 
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9 Further Human—Computer Interaction 


(a) 


Briefly explain, including quantitative estimates, how the information content 
of English text compares to the information rate that could theoretically be 
communicated using a computer keyboard. [2 marks] 


How could the relationship you have described be used in a design to enter text 
either more quickly, or with less effort from the user? [2 marks] 


Consider an operating system command line interpreter that interprets text 
commands on a probabilistic basis. Explain how each of the elements of Bayes’ 
theorem (Posterior, Likelihood, Prior and Evidence) would be applied in the 
implementation of this interpreter. [8 marks] 


Give one example of a well-known bias or heuristic that might be applied by 
users of a command line interpreter when they need to make rapid decisions. 
Explain, using Bayes theorem and/or information theory, what could make that 
strategy effective in the above scenario. [4 marks] 


Explain how the attention investment model of abstraction use might relate to 


the use of more or less abstract strategies in the scenario you have described. 
[4 marks] 
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10 Further Human—Computer Interaction 


This question relates to the design of an online tool for use by a local radio 
station, that can be used to more efficiently generate scripts for their bulletins. The 
station manager has asked you to investigate whether presenters could ask ChatGPT 
to automatically generate the evening weather report, which typically includes a 
summary of today’s weather, and forecasts for tomorrow and the rest of the week. 


(a) 


Sketch a user interface that might be used as the front end to a generative AI 
large language model, as an alternative to the standard conversational style of 
interaction with ChatGPT. [3 marks] 


Add labels to refer to two specific parts of your sketch, and explain how the 
graphical properties of those elements correspond to their function within your 
design. [4 marks] 


What analytic method could be used to predict whether your alternative 
design would be more time-efficient than the standard style of interaction with 
ChatGPT? [1 mark] 


Based on the analytic method that you suggest, provide calculations for an 
estimated (within an order of magnitude) comparison of (i) the station manager’s 
suggestion to use ChatGPT, and (ii) the use of the user interface you have 
sketched, in a typical usage. [4 marks] 


Describe an empirical approach that could be used to evaluate whether the 
estimates that you have calculated are justified. [4 marks] 


Describe up to four further considerations, beyond time-efficiency, that might be 
relevant to the station manager’s decision to deploy such a tool. Make specific 


reference to topics from the HCI literature, e.g. from the lectures, notes or 
readings, but not media reports of AI. [4 marks] 


END OF PAPER 


10 


